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ABSTRACT 

A conference on Increasing the Use of Promising 
Practices information by Local Educational Agencies was held at the 
National Institute of Education (NIE) July 14-16, 1974. The 
recomaendations developed at the conference focus on identified needs 
for: a clear definition of the tern promising practices; a leadership 
role by NIE; a p3an of action to coordinate resources; development of 
a common, user-oriented format for local educational agencies; 
selection processes and criteria for promising educational practices; 
a cooperative network for development, validation, and dissemination 
of promising practices information; a state-of-the-art study: and 
exploration of the goals and criteria for evaluating dissemination 
activities. Also included are the suggested roles that NIE, local and 
state agf^ncies, and information centers will need to assume, 
observations by Contemporary Research, inc. regarding additional 
steps that might be considered, and the usefulness of the conference 
as a joint-planning process. (Author/PF) 
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l\Jl€--C^li~0lJ3i 
ABSTRACT ot cc?y prJiiffiiE 

The document presents the recommendations developed during the 
NIE Conference on Increasing the Use of Promising Practices Informa- 
tion by Local EducsJtion Agencies* The conference was conducted for 
the National Institute of Education by Contemporary Research, Inc., 
Jiily 14- ! 1*^74, in Los Angeles, California. 

Recomm^jndatiuns focus on identified needs for: 

• a clear definition of the term promising practices 

• NIE to assume a leadership role in partnershipwith 
local education agencies. State education agencies 
and information centers 

• a plan of action to coordinate resources 



# development of a common, user-oriented, format 
for local education agencies 

m selectivni processes and criteria for promising 
education oractices 

• it cwMpc-rative netWi^rk fnr dcveli»pnunit, validation 
and dissi:nunati<»n of promising practices information 

m a s5tatt*-of-thi--art study as a prerequisite to long- 
range ptannirifj; 

m I'xploration of the goals and criteria for evaluating 
disscminatitm activities 

Also included are the implications for the suggested roles that 
NIE, local and state education agencies and information centers will 
n <'r! to assunio. A final sectitm discusses observations and sugges. 
tififis !>y Cdnteniporary KoHoarch regarding additional steps that might 
r uisiderefL and the tisefuinr^ss of the conference as a ioint-plannin^ 
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I INTRODOCTIOII 



On July 14- 16, 1974, the NatiotiaL Institute of Education (NIE/ 
held an invitational conference in Los Angeles, California, on lacreasing 
the Use of Promising Practices Information by Local Education Agencies* 
Local educators. State education agency staff and inforniation services 
specialists were invited from across the United States. The purpose of 
the conference was to identify factors that currently prevent the in- 
creased use of promising practices information, and to recommend 
strategies NiE could pursue to increase the utilizatiun of the information 
by practicing educators. 

NIE held this conference within the context of its legislative man- 
date to improve educational practice, to build a capability among local 
schools for renewal and reform, and to build an effective educational 
rcsoarch and dfvclopment system. NIE 's consequent responsibility for 
the dissemination of educational knowledge includes a concern for in- 
torftiatiun about educational pra.ctiCfS developed by local schools, 

Accordinjjly, NIE sought to incorporate the knowledge and concerns 
of representatives from all levels of the nation's educational system at 
the start u{ its program planning efforts in this area. The NIE confer- 
t ncf actively involvi'd a representative consumer group in mutual prob- 
lem identification and needs assessment, and in determining the role 
NIE should a6is\m\e iti facilitating the increased use of promising prac- 
tices inft^rmation. 

NIE invited 40 participants from the following agencies who were 
considered to have first-hand knowledge of the problem in an operational 
sfinse: 

• L^>ca.l education agencies (LEA's) 

• State education agencies (SEA's) 

• Inf<irmati«m centers and services working 
directly with local educators. 



In addition t" stai£ from NlE's Office of Dissemination and Resources, 
Federal proitram specialists from the U.S. Office of Education also 
attended. A list of all participants, with their organizational affilia- 
tion and titlesi appears in the Appendix, 

The participants from the field represented the essential constit- 
uency with whom NIE will need to work as it becomes more directly- in- 
volved in improving the dissemination and utili;eation of promising prac- 
tices. An impijrtant characteristic of all conference participants^ and 
of tho IwEA's in particular, was their evident leadership in the forefront 
of educational change. The cm .'xice recommendations are thus based 
on judgment of a highly informed, aware, sensitive group as to what 
.ould make a difference in the C irrent state of the art of dissemination 
and utilization of promising practices information. 

C«»ntemporary Research, Incorporated {CRl) was asked to conduct 
the conference and Serve as the facilitator responsible for all conference 
and travel arrangements, for preparation of a pre-conference working 
paper tiut lining concerns and issues, and for the design and ttanagement 
of thi- cunftTonre workxhijps, A summary of information from the 
working paper, and a hri««f description of the facilitators backgrounds 
are incluc!»-<i in tht* Appt?n<iix, 

CRTs most critical task, r«^prcsented by this report, has been to 
pnjvide both NIE decision-makers and professionals in the field with 
the issues, <oncerns and priorities developed at the conference, in 
order that they could be incorporated into planning activities for the 
cominii year. 

Thcr Conference 

In pJaci- of a forrtial agenda, the conference was characterized by 
a partially structured format di«sigm;d to focus discussions in small 
t-roup vv'>rhshop« ^s«'e Fvhtbit 1). Nti isstu* papers were read by 
<*>cpfrtsi, to which participants could respond, nor were there panel 
<f i scus si'mji Ijrfuri' large groups. 



CONFERENCE AGENDA 



.Suriday Evening! Or!i*ntatit>n Sossion 
Monday \ Tiu'sday; 



Session I: Neede Assessment 

• Problem Definition ; What Factors 
Hinder the I'sc of Promising 
Practices Information 

• Assessment of Resources and Kolationships 

tvir Dt'aling with the Problem 



Si'SHlon Ih Development of a Plan of Action 

• r>eveIopmetit of Strategien for F acilitating 
the I'tie of F^rotniiiinn Practices Information 

• Priorities for Implementing Strategies 



Definition of Critical H«»ies in Implementa- 
tion ffir r.EA'K, SFA's, Information 
Cffiters - - and NI^: 



i'.xhibit i. Cimicrvnci- Am-ndn on Inc ri.i ,sin>4 the I'ai' of 
Promising Practices Inforniation 



In order to most effectively utiliise the wide diversity of cxper. 
iencc and perspectivfs at participants, CRI utilized a workshop approach 
in which participants were diWded into four small groups with represen- 
tatives from diiicrent organixational levels and geographic areas. The 
flmall f?roup discus aions were designed to fully access and utilize the 
knowledge, fxporicnco, and creativity of each individual, in order to 
develop thi- rt-quested report, Dxtring the conference each group was 
asked to bojjin by defining thi' problems that hinder the use of promising 
practices information and to identify and assess resources and strategies 
that tuuUi overcome the problems. From this *ramework, further dis- 
cussion led to the dovelt>pment of specific recommendations that could 
be prt'Sfnli^d to NIE t'«»r consideration in its planning. 

hi order to provide leadership and direction to the gr.oups, CRI 
provided lour experienced facilitators who were eminently qualified to 
interact with the participants as peers. They were; Dr. Howard Add- 
man. Director of thv Fernald School, L'. C. L.A, ; Dr. Asa Hilliard, 
Dfdn of Education, San Francisct* State University; Mr. Ron Lopez, 
Senior Consultant, Coiitt-mporary Hesrarch, Inc., and Diane Watson, 
St-niijr Consultant, Cuntvnvpi) rary Ueiifarch, Inc. 

As a result of thf joint oft'orl ti»ward problem solving and strategy 
plan{\inii, thv conferoiuo not <tnly produced a set of recommendations, 
but also a sharin}» of iuiormali.»n and perspectives; j.e. , immediate 
disstmiuation among participants. The open interaction and subsequent 
untU'r.stin'iinu "t eat-h -ther .s r..lt-s and probU n\H waf* clearly essential to 
thf 4-ii»'ctiv*MU-8s th»- iiilorn.atifoi oxchaiiitf, 

Th«' Report 

CiU s ctinccpt of the conference report is that it should be useful 
not e,niy to ME and conferenct; participants, but also to other individuals 
and auencios involvod in the developmttnt, dissemination, or use of 
Ui 'Mnisinu practice's inf«jrmation, 

Thf conference report was prepared from the tapes and notea t»f 
lh<- ItKlividual wc/rk.shops tnd iv^m p;irtictpant'H written rectimniendations. 



and irom analysis of the matiner in which participants proceeded to meet 
the conference objectives. The report thus reflects an integration and 
synthesijs c^f the diversity o( perc^pective^ provided by participants, as 
well as the consensus that emerged about particular problem areas* 

As the conference progressed, awareness developed among all 
participants that the complexity of the problem and time constraints 
prec luded the conference or report from identifying and resolving all 
the problems related to the use of promising practices information. It 
theretore became apparent that additional conferences and workshops 
are necessary to adequately explore this whole area^ 

Tho remainder i>f the report has been divided it^o two major sec«* 
ti<ms# Section Twci, Conference Recommendations; Priorities fcr Action 
pre sents an overview of some of the problems related to increasing the 
uBe <»f promising practices* information, and then presents and discusses 
tho rt^commiMidationji which rosulted^ The recommendations focus on 
NIE ji leadership rule in partnership with the field, and <m the need for 
a plan t»> coordinate r^sourccs^ The specific areas a plan of action 
;\i t is* lu addrcsij include*: definition uf prinnising practices and of the 
inforn aliiMi aboot thrm noedod by tlie users; the development of a common 
usor-nfitMitcd fi^rmat, CMn.sKstiMit selection processes and criteria; State** 
level ntiWfjfKs for cuo rdinati n:4 inturn^atii>n development, validation and 
disseminat i«»0 at :tivitii*$». 

This soctiun cone ludes with an analjrsis of the implications that 
thesse rrf^ itinitiendiiti^uis have, in terms of the reliUi^mshtps and roies 
of mait^r ioniponents in the **Hyslenv' NIK, the SKA's, I.KA's, infor- 
mati^ui rente rn and services, and una versitieSt 

Si ition rhre€% CRl Observations , pr«ivides some additional 
sui;i4estionr5 CAil believes are indi coated from the priorities identified 
by the conferiMu e, and some /^onclusi^ ns concerning the usefulness of 
t^t* r<>nfcrence, and the valuo nf i•ffor^s to increase the use of promis-^ 
practices inf<»rniation. 



il. THE CONFERENCE RECOMMENDATIONS 
PRIORITIES FOR ACTION 



T'^*' Overview which appears below defines some of the problems 
and issuej* that i-esulted m this conference being held for NIE and 
attempts tu provide the reader with a frame of reference generally 
t^hared by those at the coiitcrcm e. Following the Overview are the 
rt'commendation^ developed by the four workshop groups. Some of 
the recojtvtnendations wore independently reached by more than one 
uruup as one of several priorities: other groups developed a single 
recommendation which represented their major concern. The sec- 
tion cuncludes with the implications fur implementing the rccom- 
endations^ particularly the rules NIE:, the States, information 
ci nters, local education at^t-ncies and universities would need to 
asijiiint', 

OVEftyiEW OF TN£ fSSUIS 

VVomisinj: practicvs is the term currently uned to include 
U'acfiinu and sciu>.t| manamt-ment strategies, curricula t>r teacher 
•u.iterjals, and t ompreheuriive tdutational proijamsi that have been 
developed and Ui^ed \»y local schools to improve education, and that 
are now potenlLniy disMMninrlile to fjther schools. 

Till' « on5.T«Mu «' f.tpit W is thf u.se u( the information about 
promiHinu prat ticf.s. ' 'se in thin t ontoxt was generally agreed 
to incbidi- any h've! ,,f information use, f>*>m Hcanninj: to set ideas, 
to considering whether to adt»pt a new program l>ased on all the 
availahh' infortnation related tu i!, 

Th«' lack of (.nsi' .studifs ant! docuitu-ntcfl experience in this 

tr. i hindi-r tn icrnratf, substantiated overview t)f the problems 

— 

related io locrearttnu th«' use i»l prrnfnsin»j practices. The recom- 
•lu-ndai ion.s in .^onie ways an- ik o ich Ktrate«ies for clarifying and 
oruanizinu ihi- probleois as a!!ythin^ f-Ut^, \V»»r<' Ihey to be imple- 
'nented, a fjtuch rlearer picture uf the problems expe rieiici'd by 
!J A's in the -iHi- <,! promising; pra«.tices informati«^n wmild exist 
'.tj Alorh fo base s./uful st ralt-i* i fs i^tr Hif.Teasing uki». 



However, with thf recognition of how Httle is yet known, and of 
thf ^'entT.ili/.ations that t'xi«t. tht;-i overview imtUnes briefly jiomc 
genern! perceptions oi tne probletiis and issues, in order to provide 
thv reader with a frame of reference generally shared by those at the 
conference, 

A h.i.stc as suTr.pt ion by professionals involved in this field is 
that practit inu edllcator^ most *^ften look to other schools ^or solu- 
tifins to iht'ir educational problems. Far most local educators this 
search is assumed to be confined laruely to schtiols nearest their own. 
At cidental access to an approach being implemented at some distance 
niay occur throt;t.'h personal contact at conferences, or through vari- 
ut:s prufcssit)aai journal articles. Constraints of time and money are 
obvious lit-nitntions on seeking out information. Other constraints, 
lot > . oLvious. 'r.ay be the traditional autonomy of each school district 
wbuh tentij; t<> reduce incentives for adopting new practices from the 
■\.utsjde and the need lor perstmal contact with people who can pro- 
v:df accurate mformatiiui ab.nit a uiven practice. As yet there are 
oniy sc.tttereti infurMiati.ui services and centers collecting and dis- 
i-«"oinatinii such information to l.ICA's: therefore, a j^eneral picttire 
v)t liie uses, and va'iu' of such inforfnation by a representative range 
of I ,I !A ' s is lai. kf ny. 

Most I.KA staff, thereLyre, have difficulty j^aining access to 
information about proniisini: pr ictices even in their own region, or 
at State or nati<uial levels. In these States or regions where an infor- 
mation systeiT^ now exists, coUe< ting the information that is accessible 
f!.u-s not lUtofTiatically iead in use. The user's problem or need usu- 
al! v requires refinement through interpersonal "inqtiiry negotiation", 
%n order to reroive the most apprf;pr!ate information. During adap- 
tion <»f a particular approach, specific technical assistance for needs 
■tssessinonts. and for staff training may be necessary in order for 
thf information to be utilised and thus aff«.ct actual classr(»om practices. 



A national file or infortnation bank for promising practices 
information does not exist at present. The Fducafional R(>sourcP8 
Information Centers, ^ERIC) system cannot easily be used to collect 
and retrieve promising practices information. According to confer- 
ence participants, many local educators have "never heard" of ERIC, 
and those who have do not know how to use its resources in their pro* 
gram planning, A number of states now possess collections of prom- 
ising practices, usually as an outgrowth of Title III, ESEA efforts; 
however, the problems of managing such : -.formation, and how to 
increase its use by LF.A's were among the concerns that led to the 
conference. 

The complexity of the local education agency requires that 
types of users and levels of use must first be identified before an 
understanding of how to increase "use" can be gained. Teachers, 
building principals, and siupe rintendents all have different needs 
and different informatitm-seeking behaviors. It is apparent that 
increased use will occur as the intt^rnal LEA procedures for estab* 
lishitij^ educational objectives, assessing needs, and determining 

wile re changes are rcquirc^d. bocume n\ore effective; and as the 
internal resistance t<> change on the part uf teacliers and adminis - 
trators is replaced by an on^going participation in decisliun^making* 

Whether or not promising practices should remain in a separate 
category or categories from the products of educational laboratories 
and centers is still an open question* One aspect that does separate 
them from other edticational programs is the difficulty surrounding 
their identification and selection, and the production of descriptions. 
There are seldom rest>urces or incentives for the local educator to 
evaluate or validate his program, c>r to prepare materials necessary 
tor its dissemination. Kducators charged with the respunsibility for 
information dissemination do not have a ready-made supply of descrip- 
tors to select from, nor is there any agreement as to the standards 
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such programs should meet. The problems oC identification^ insuring 
adequate descriptions and screening out programs having minimal value* 
are unresolved. Other unresolved issues include whether promising 
practices ^re being selected that indeed mee<; the needs of local education 
agencies, Dt)es the lack ot quality control procedures result in LEA's 
not using the availabieUinformation ? Should only validated programs that 
have ' hard 'evidence of success be disseminated? 

A strong feeling, expressed particularly by f.EA's at the confer- 
ence, was that the available promising practices information is not 
' useful" for several reasons: I) the descriptions are not fitted to the 
consumer's needs so that they can be easily accessed and compared 
at an initial interest level: 2) the information is not organized and 
accessible in terms of what LEA's know, nd want to know; the poten- 
tial consumer is left with too many unanswered questions: 3) the de- 
}5cription of the practice often relies on research results and language, 
and heconies an imn\ediatc "turn-off" to many potential consumers. 
Now rf forts 

One prt>blem for policy planners is caused by the recency of 
prt»gran>s and services in this area. State-level efforts and the crea- 
tion of information centers to directly meet LEA needs have come 
about nnly in the last five years, and until now there has been little 
possibility of documenting the knowledge that has been gained, 

A number of State education agencies are beginning to develop 
a comprehensive approach to the identification and collection of infor- 
mation about promising educational practices, and are moving beyond 
the concept of information dissemination to providing technical assis- 
tance in needs assessment and implementation (included in the concept 
of "diffusion ■ Although inmost States dissemination is still viewed as 
a function only of the Title III, ESEA program, those at the conference 
represented examples of the potential development of the SEA's role 
cit Ti'Ss Jill {^ro^rams. 



Now inforniatiim ccntors stTviccs have emergt-d, some in 
conjututtun with the FRIC: C:ioa rinj»h(>uses (such is the Science, 
MathoniaticH, and Rnvi runfticntal Education Asj?istance Center at 
Ohio State I'nivtTsity) or in relation to curriculum, particularly in 
vocational education. Thf most sij?nificant new concept is the local 
nr regional inlormation center that links local schools to national 
data hanks (KfUC. and other social science research collections), 
and tnaintains its own collections of educational resources and prac- 
tices. The San Mateo Educational Resource Center (SMERC) in 
California, the Board of Cooperative Educational Services in northern 
Color.idc*, the Research and Information Services for Education Center 
(RISE) in Pennsylvania, and the Educational Resource Centers oper- 
ated by cooperatinii .school districts in Merrimack. Massachusetts, 
and New Ilavcn, Connecticut, represented this new type of institution 
at the conlerence. These local centers sell various information ser- 
vices to subscriber school districts and work with resource specialists 
who are part of the It>caf school staff. They are .iow becoming partly 
or entirely sustained by direct local funds, although most began with 
Federal grants. 

These activ ities and programs represent a rich source of empiri- 
cal knowledge about the use <if promising practices information, and 
about the factors that can facilitate increased use. One major purpose 
of holding the conference was to incorporate this information into pro- 
gram planning for this area, as it is not yet available except from 
individuals involved in day-to-day operations. 
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REeOMHEttOATIONS 

Introduction 

The conference attempted to understand the factors that hinder 
the increased ime of promising practices information from the local 
educator's point of view, as he seeks information to resolve problems. 
The recommendations grew out of the initial discussions of problems 
from this user perspective, and from the point of view of those 
involved directly in responding to user needs. 

The effort to arrive at priority issues prevented specification of 
much detail in the recommendations. If additional time had been . 
available, the conference could have spelled out many more strategies, 
and identified specific criteria and processes. These recommendations 
then, define the major national priorities which NIE and the field 
together should address. The discussions arc intended to give the 
major considerations and concerns that led to their formation. 

The Overview of Priority Issues and Recommendations on the 
foUowins page (Exhibit 2) illustrates the relationship between these 
factors identified as hindering increased use, and the recommended 
actions. 



11 



0 

H 
S 

0 

u 



c 

o 



c 

0 
u 



0 



c 

0 



u 

c 
m 

c 

c 

u 



6 E 



o 

f 

a> 

CO 



1U 

C 



c 

y as 
CO 



(0 

C 

nj 

CO 
SO 



^ o 



O 

o 

o t *- 



» 0 
c *^ 

c c 

c 

E 



s 



h5 



< 

W 
o 

Vm 
DC 



> 

a 
o 
o 
U 



A 0 

w;2 



a 

to 0 

.2 § 

o > 
o a# 

ua 



6k 



I 
f 

O 
f 

to 



O 09 



0) 



0 c 
Ik 



0^ 
CO 
01 



u 
Q 



2 « 



o 



P 
O 

o 



% 

t 

u 



12 



ERIC 



A J o i lit Plan o f A c t i^>_n 
Rcconimi'ndation ; 

ISIIE should develop and share with the conference participants 
and others a plan of action for efforts to increase the use of 
promisinp practices information, which involves all levels of the 
education system in. its implementation. 

Evolving from the conference was a strong request that NIE develop 
and share a plan of action for improving the developing, dissemination 
and utilization of promising practices information. A committment to 
this shared plan of action was identified as the first step toward a strong 
leadership role by NIE. 

NIE's ability to communicate what it is capable of doing this year 
ia essi-ntial to the development and the encouragement of this partner- 
ship. Participants recognized that vast funding resources were not ess- 
ential elements fur XIE' s leadership} rather, honest communication and 
trust were identified as the necessary ingredients in such a relationship. 
But more than communication is necessary; participants requested an 
active participation in which strategies can he jointly developed. The 
confe rente pointed out that the constituency that NIE could work with 
already exists and is willing to tnUo an active part in improving the 
dissemination and titili/.ation of promising practices information. 

Participants expressed willingness to continue to work in partner- 
ship with NIE, even if resources are lacking for the implementation of 
specific recommendations. Participants viewed the conference as a 
positive, initial step, and expressed a desire that this type of communica 
tjt>n an(} information sharing continue on a regular basis. 

This concern for partnership emerged as a central issue at the 
conference, and was seen as the focal point from which a joint plan of 
action could be developed. As a result, the recommendations that fol- 
low speU out the specific areas that the plan of action might address. 
They are by no means all-inclusive, but they focus on those areas of 
concern which conference participants agreed had the greatest priority 
for increasing the use of promising practices information. 
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Ua<^ r -O ri<-nted Infu rmation 
Recommendations t 

1. Program and product description formats should be 
based on items LEA's need in order to consider 
alternative programs and practices. 

2. NIE should assume a leadership role in the development 
and implementation of a standardized format for informa- 
tion about promising practices. 

Matching the infurmation to LEA concerns and problems as 
teachers and administrators understand them remains a priority. The 
workshop discussions served to emphasize that despite the consensus 
that the information should be user-oriented, much more work needs 
to be done. 

Describing What LEA's Want to Know . In order for information 
to be utjed, it must impact on the consumer as being useful. Through- 
out the conference, examples were offered of information that LEA's 
crmsider most useful when considering a promising practice. The sum- 
ma ri/.ati«n which follows is based on the insights and statements of 
these participants. 

LEA'S clearly dislike sales pitches and descriptions written in 
glowing terms, which: I) give a distorted picture of what the practice 
is really about and, Z) often avoid mentioning the specific problem for 
which the practice was developed. Practicing educators appear to look 
first at whether a program or practice matches their problem in enough 
respects to have "promise" of being useful. Questions such as, "What 
type of community was it used in?" "How much time and money were 
involved?" refi- ct the nature of the initial questions LEA's ask. 

A second major type of information LEA's want very early in the 
process are "user reactions, " that state good and bad points, constraints 
encountered, and the initial user's feelings as to whether or not the pro- 
gram was successful. At present, local educators rely on peer evalua- 
tions and comments as being more helpful and comprehensive than the 
type of evaluative data usually available. 
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Quv major prublotn in Ucrfc ribing what local educators want to 
know is to recogni/.e the different levels of information needs within 
and to develop descriptions tailored to teachers, principals, 
miperintendent's staff, and community advisory groups. 

A Common Format for Promising Practices. One of the most 
common reasons given at the conference for LEA's not usuig promising 
practices information is the lack of a standardized format which would 
readily permit LEA staff to access the information and which would 
allow information to be readily transferred among States and various 
information centers. This problem of locating what is available could 
be alleviated by developing a standardised format which would reduce 
some of the frustration involved in the dissemination/ utilization/ 
adaption of promising practices. 

Perhaps the most far-reaching implication of the common format 
i.s the educational potential for "standardising" locally-developed pro- 
mising practices. The major purpose of the format is to provide com- 
parable descriptions, but the c(»n£erence foresaw that implementing a 
coninu»n foriiuit would lead to an evolutionary change in the quality 
and comprehensiveness of the materials produced. In this manner, the 
format would encourage the development of a consensus among local 
educators about what a promising educational approach should be. 

A working concept of what a standardised format should include 
was developed by one workshop, and is shown here as KKhibit 3. 
The format in divided into two parts. Part I consists of information 
in the ft>rn) of a brief abstract that a consumer could see as part of an 
initial st^arch. It is designed to enhance the LEA's access to the types 
of programs that are available. After completing the initial search, if 
more information is desired, the requestor could then ask for further 
information, identified in Part II of the f<»rmat which is designed to 
enable the potential user to gather and compare data needed for adoption 
or adaption of a particular practicru. 



PART I 

• Type of Activity/Practice 

• Date produced 

• Is the Program Still in Use? 

• Specific Descriptors (ERIC Model) 

• Narrative /Abstract 


PART U 




• Institution identification 




• Name and Phone No. of Key Contact{s) 




• Funding Source 




• Program Components 




• Problem Areas Addressed by Program 




• Program Goals 




• Pertinent Value Orientations 




• Characteristics of Target Population 




• Characteristics of Program Integrity 




-- Systematic /Technological (e.g., Teaching Methods) 


-- Personnel /Personal (Personalities as well as 


Professional) 




Time /Money 




-- Community /Contextual 




Social /Personal Value Biases 




Baseline Data - -Available Measure for 


Adapters 


Adopters 


Test of integrity of Use 


• Contrast with Standard Practices 




• Materials Available about Program (e.g.. 


Evaluations) 


• Materials Required tor Program 




• Type of Evaluation 




• Evidence of Success 




• Visitation Rights 




• Morale Factors 

1 





Exhibit 3. Suggested Elements for a Common Format 



16 



Many tif the components of the furniat are self-explanatory, but 
sonic present new concepts that emerged in response to the question, 

*»hat do LEA s really need to know?' In Hart I, the question, ' la 
the Program StiU in Use?' was included in order that the potential user 
could answer such questions as: Can it still be viewed? When was it 
initiated? This was of primary interest to LEA's. The specific descrip. 
tors in Part I might be similar to those used in ERIC. 

i'rograni goals only briefly referenced in Part I would be specified 
in mure detail in Part II. "Value Orientations" are also included to point 
out how the program responded to a certain set of value orientations. For 
example, if a community was very concerned about intellectual integrity 
of a prijgran^, a consumer would look carefully at this category for such 
information. 'Problem Areas" refers to the need for information de- 
scribing why a program was developed, as LEA's are basically looking 
f<»r programs that were intiated to solve problems similar to their own. 

The catognry, "Characteristics of Program Integrity" is meant 
tt> describe th»- essence of the program which is necessary to maintain 
its integrity when exported to a new setting. Since most consumers 
adapt progratj^s ro suit their own needs, they should be aware of what 
is flexible about the program, as well as the kind of methodology, hard- 
ware, and personnel costs that are essential components in the program 
design, A statement by the program developer concerning the com- 
munity and contextual /environmental variables, as well as the social 
and personal value biases of the educational practice, was also viewed 
as necessary information for the potential user. 

The "Type of Evaluation" was felt to be one of the most essential 
elements in the list which would clarify the kind of evaluation data that 
exists abotit the progranu A checklist was suggested so that readers 
vv«ntld know specifically what type of evaluation was conducted. Examples 
given were; standardized tests, criterion referenced tests, interviews, etc 
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The conference recognised the difficulties that providing the 
comprehensive information would present^ particulArly for local 
school staff. However, the format is seen as establishing necetsar/ 
standards to ensure the informations usefulness; thus outside technical 
assistance or other resources should be available to UE:A*8 to meet 
the information requirements. 
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Thi^ Selection uf ProtYiising: Practices to Match LEA Needs 



Recommendations? ; 

1. Two major categories of promi&jing practices need to be 
developed^ One would include information on programs 
that have been validated; the other category would be a 
comprehensive file, with promising practices selected 
as alternatives on the basis of screening criteria^ but 
for which validation data on outcomes is not yet available* 

2, NIK should work in partnership with States and other agen- 
cies to ensure that the processes for identifying promising 
practices and the criteria for nomination and selection are 
consistent, and reflect the range of promising practices 
rather than only national priorities. 

The recommendations concerning the selection of promising prac- 
tices to match LEA needs are directed at insuring that there is access to 
the full range of educational ideas and approaches. Participants were 
very sensitive to the reality that promising educational practices include 
a multiplicity of outcomes, for which no adequate evaluation measures 
may be available, and that little or no money existed for LEA's to con- 
duct evaluations. Both the possibility of overly restrictive selection 
criteria, and the current inconsistencies among different States and 
programs over what is meant by "promising," require resolution. 

Categories for Selecting Promising Practices . The concept basic 
to this recommendation is that different categories of promising practices 
exist, which meet different needs, and therefore, practices should be se- 
lected according to somewhat different criteria. 

A source of frustration to LEA's is having to confront the sheer vol- 
ume* of promising practices in an unorganized fashion. But eliminating all 
access to those programs for which there is no existing evidence of effec- 
tiveness also results in an equal degree of frustration. LEA's tend to view 
the a^iplication of rigorous student outcome criteria alone for screening 
promising practices as preventing them from makinu their own judgement 
about a program's quality an ; effectiveness. 

The need for alternative promising practices formed a large part of 
the discussions about selection criteria and what LEA's want. The 
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local admimstrator would like access to an organized collection of 
altornatives to provide him with a frame of rcf«?rence, an idea of what 
is "possible" in meeting a given problem. The relative effectiveness 
of one approach over another is unimportant at this point, because he 
is not committed to a given approach, or even to changing his program. 
Promising practices information, at this stage, appears to meet the 
need for understanding one's options, prior to a decision to solve the 
problem. 

This use of promising practices information may lead to a decision 
to adopt a particular program, or to develop one by combining a number 
of components. In either case, it is substantially different from seeking 
out an effective approach in a given area. Therefore, two major cate- 
gories are suggested as offering an effective way to begin organizing the 
current mass of promising practices information, as v eil at. also meeting 
the need for more af'ernative programs. The two categories were termed 
the "Effective File" and the Alternative File," as shown below in Exhibit 4. 



Effective File 


1 

Alternative File 


FTtfectivcness validated by 
1 specific outcome data. 


Descriptiona of alternative 
approaches organized by 



problem or need addressed* 



Resources enabling move- 
ment to Effective File* 



__! 

F:xhibit 4, flntogorios for Protnising Practices Information 
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Programs in the etfective file would have documented evidence 
of their effectiveness. Additional subdivisions of this category might 
be useful, but basically, all would meet commonly accepted standards 
of evaluative research. Examples of existing collections that are 
judged to fit into the effective category include current USOE projects 
to identify and package exemplary programs in compensatory educa- 
tion (Project Information Packages) and reading (Right to Read- 
sponsored efforts to disseminate successful reading programs). 
Various collections of alternatives exist now in information centers 
and at State levels in su rh documents as PACE (a publication of 
Pennsylvania Title III program), and the ALERT catalog, published 
by the Far West Laboratory for Educational Research and Development. 

The alternative file (or comprehensive file) would have crit .a 
that: n would censure some quality control, 2) screen out programs 
not of substantial interest, or that lack documentation and evidence of 
something exportable . Nomination by a professional outside the 
program (and LEA> was suggested as one important screening technique. 

The controversy concerning the question of whether programs 
with no evidence of impact on student outcomes should be selected and 
disseminated, can be resolved by understanding that; 

1 LEA'S do have the responsibility for finally judging a 

program's worth; 

2 Promising practices information is useful to LEA's when 
conjidering a wide range of ideas, alternative approaches 
and new programs focused in a single problem area; as 
well as when seeking a single, "exemplary" mcf? .;l; 

3 Funds are not presently available to validate more than 
. handful of promising practices. Thus, hard data on 
outcomes will not exist in the near future for most pro- 
mising practices, for reasons entirely unrelated to their 

valui.- or "protiiise, " 
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As a large number of promising practices would be eligible for 
ronsideratioa, Lhc alternative files mi^ht be best kept at the State 
level, rather than storing the practices in a national clearinghouse. 
A common format, therefore, is essential to this file in order to 
allow LEA'S to compare alternative approaches to the same problem. 
If a common format for information was made available, a number of 
criteria based on profcssiunal judgment and acceptable to both the 
producer and consumer could be built into the procedures for entry 
into a (Ih.^. 

Consistent Processes and Criteria . The lack of consistency in 
the identification, nomination, validation and/or selection of promising 
practices is a major barrier to increased use, and is a primary source 
of frustration to everyone. The lack of common standards that local 
educators. State departments of education, and Federal agenr' s all 
agree to results in the identification of many programs which do not 
deserve recognition, while many others remain unrecognized and inac- 
cessible. In addition. Federal funds frequently are tied to current 
national priorities that tend to change quickly and arbitrarily, parti- 
cularly from the LEA point of view. Therefore, it was felt that cri- 
teria for eligibility as a promising practice should ensure that a re- 
re«cntative range <,f educational programs is reflected and screened 
into the various files. 

General agreement was voiced that the selection process should 
take place at the State level and feed into the Federal level. Federal- 
level personnel normally do not see practices in action; therefore, it 
.«*eems the proper job of States to screen for effective or alternative 
programs and practices. This places responsibility on the States 
finding a mechanism to keep in touch with local programs and prac- 
tices. Suggestions of how this might be accomplished werej I) 
through nomination of a program either by the developer or by some, 
one else selected to do so, or 2) through a selection group created at 
the State level consisting of all parties involved in such programs and 
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and. practices (higher education, teacher uniona, and State and local 
representatives). This group could identify two types of programs: 
one set of programs which would meet very specific validation cri- 
teria; a second set would be identified as alternatives meeting only 
broad criteria for quality control. 

NIE was viewed as responsible for suggesting to States that they 
develop a selection procedure for identifying effective programs. NIE» 
leadership is needed to help stimulate such a process, especially in 
areas where efforts currently do not exist. 
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Training for LEA Staff 
Recommendation ; 

Funds and training should be provided to State and sub«State 
levels so they may assist LEA's in becoming aware of infor- 
mation about promising programs and in implementing selected 
programs. Outside facilitators should be trained and provided 
to help schools identify needs, to help them identify possible 
solutions, and to help them install programs and practices. 

Training for local educators is recommended as a strategy 
for increasing both initial use, in the sense of seeking out informa^ 
tion. and also facilitating greater implementation by adoption or 
adaption of programs or practices after a decision has been made. 
This system of training would focus on increasing the LElA's capa- 
bility to use all types of promising practices information which is 
or will be made available. 

The type of training recommended would focus on the use of new 
materials or programs, on curriculum design and development, and 
on needs assessment. These skills are the necessary prerequisites 
for local educators to effectively use promising practices information. 
Neither pre- service nor in-service training for teachers currently 
prepares teachers for the specific strategies to cope with changes. 
Training of administrators frequently omits preparation for the 
development of program planning skills, and orientation toward 
using outside information and resources. Rather than continuing 
to label local educators as "resistant to change", participants rec- 
ommended that NIE support efforts to assist more of them to learn 
the skills needed to plan for and carry out change. This recommen- 
dation is not focused on training all teachers and principals to become 
"change agents", but to provide the awareness and skills which allows 
them to seek out help, information, or assistance from change agents. 
Thus, training is not meant to imply training for a specific prog *am, 
but rather to include overall skills which could be applied to the devel- 
opment, adoption or adaption of any program. 
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State agencies, regional service centers and universities are 
viewed as having primary responsibility for carrying out training. 
Hoth on-site training, and training held at information resource cen- 
ters were suggested. Many of the information centers represented 
at the conference conduct active training programs that bring local 
educators into the center, where they can explore the materials and 
ideas available to them. However, travel constraints and the initial 
reluctance of many LEA's to spend money for such training are argu- 
ments offered in favor of training in local school districts. 

An important second phase of this recommendation points to the 
need tor the training of facilitators who can offer technical assistance 
directly to the schools. A major problem encountered by local schools 
is the matching of available materials to their particular needs. It 
was suggested that two types of facilitators would help solve this prob- 
lem; one facilitator could act as a resource person informing the 
i^ohools of what is available, and subsequently assisting to create a 
climate of readiness; and a second facilitator could provide necessary 
assistance in the implementation of a suitable program. 



ERIC 
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A Cooperative Network 
Recommendation ; 

NIE should facilitate and provide leadership for the development 
of a network of various agencies at all levels of the educational 
system in order to increase the development, dissemination 
and utilization of promising practices information. 

This recommendation developed from a strong consensus that 
the first step to increase the use of promising practices information 
is to organi?.*» a constituency that includes all the necessary agencies 
who now have or should have some responsibility in this area. NIE 
needs to develop a process which will facilitate interaction with this 
''collection" of agencies, and which will allow a thinking through of 
the relationships, roles, and approach capabilities required. This 
recommendation resulted from the struggle to resolve several 
problems: 

1. How can NIE impact on all 18,000 local education districts 
in an effective way, and yet not "bypass" important politi- 
cal agencies in the education system? 

2. How can presently competing power groups become in- 
volved in a cooperative system? 

3. What can NIK accomplish when it currently has very lim- 
ited financial and staff resources to work with? 

Exhibit 5, NIL's Relationship with Various Agencies in Developing 
a Cooperative Network, identifies those agencies that have a significant 
role in the area of increasing the use of promising practices informa- 
tion. The arrows indicate an initial visualization of NIE relationships 
with other agencies, intermediate units which serve a number of indi- 
vidual school districts, and large city school systems which serve 
major student populations. The solid arrows indicate a. direct or 
formal relationship; the dashed lines indicate an informal, or purely 
informational relationship. 
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This visual picture of a potential network initially conceived in 
terms of "dissemination" fvulvi'd to inclucie the functions rf informa- 
tion development and validation of promising practices, as well as 
providing technical assistance in implementation. 

Three specific steps are strongly recommended to NIE as 
strategies for implementing this recommendation. 

• ^i£2_L* should convene an initial workshop with key 
staff from NIE, the U.S. Office of Education, and the 
Council of Chief State School Officers, in order to develop 
support for this proposed network of agencies. This work- 
shop would serve to ensure agency commitment, clarify 
different areas of responsibility, and to identify individuals 
and agencies that should be involved at other levels. 

• Step Zx A Task Force, resulting from the initial work- 
shop, should plan workshops to be held at the State level, 
and determine the financial support and resources (people 
and techniques), that would be needed by the States. 

• iii£P-i- State should be invited to hold a State work- 
shop utilizing the support and resources developed by the 
Task Force, and to develop an operational plan for a state 
network for the purpose of information development, vali- 
dation, dissemination and utilization of promising prac- 
tices information, A suggested but less desirable alter- 
native would be to set up a pilot study with a few States, 
asking them to develop a planning model which other 
States inight follow in the future. 

Exhibit 6, Workshop Planning Matrix for Developing a State 
Vtodel, indicates the potential functional or operational roles that 
must be assi'.nied in order to increase the use of promising practices 
information. The need to clarify these roles in order to reduce the 
power struggles between different levels of the educational system is 
a major concern of this recommendation. At present, the State 
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edticatioti agency and within -State information centers are potentially- 
competing tor major roles in dissemination. An honest assessment of 
the State- level capability to serve a central collection- dissemination 
function is critical; the State should have first option to take on lead- 
ership as the central agency in collection and dissemination. If it 
chooses, it may pass operational responsibility on to an information 
center <such as RISE or SMERC), or to a State-funded regional ser- 
vice center (as in Texas) that already has the capability. 

In order to carry out each of the responsibilities mentioned, 
each State would have to initiate new discussion and definition of its 
capabilities. This would result in the development of a unique plan 
for each State suited to its own individual configuration. 
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State -of -the -Art Study 
Recommendation ; 

NIE should conduct a systematic study of previous and on-goine 

t "n iVc'udlnr't? ^'^-^-^-^l^ promising practices inf^r^, 
tion, including those programs that assist LEA's directly in 
needs assessment, access to relevant information, and technical 

rLLarTh^eces'i^r state-of-the-art stidy is action ' 

research necessary for effective program planning at all levels 

redetTitenciel';'.^^^^ iavo^velocai: State Ld ' 
8ho«lrf K .^'V^ programs. The state-of-the-art study 

fh^tt ^ ^^""^ ^" overall, long-range plan of action for 

the management of promising practices infoLiationrthe studv 
tTon f^Jri^'^'r <ttsseminated for mutual impleS^^^^^^ 

tion to various local. State, and Federal agencies «nd programs. 

The need for a state-of-the-art study to document and clarify what 
IS already known is essential, before NIE proceeds to develop new "sys- 
terns" models, or long-range strategies. The conference participants 
came reasonably up-to-date about their areas of concern, and still 
found that the value and diversity of the experience from across the 
country was far greater than they had expected. This encounter re- 
emphasized the fact that "re-inventing the wheel" is also a problem for 
those involved in dissemination, and led to a stress on the value of draw- 
ing from already existing resources, as NIE develops some type of new 
coordinated system. 

Implicit in the thinking of many participants was the concern that 
a fijreater number of competitive or mutually exclusive dissemination 
systems might emerge, resulting in one for ERIC for promising 
practices, one for R & D products from the educational labs and centers 
in addition to the existing Title m dissemination efforts, and the spe- 
cialized networks (i. e. , vocational education curriculum network). A 
strong point of the conference was that investigating what has already 
been done is a serious and critical first step NIE needs to undertake 
The study would be a valuable resource in preparing a soUd foundaUon 
for systematic planning by NIE and others, particularly at the State level. 
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The recommendation for a staU-of*the-art study is clearly not 
a rccommendatioi, Xui cumpilafcion of research or existing literature* 
but a study of the previous and on-going operational efforts (in which 
partipants are individually involved) to collect and disseminate locally- 
developed programs and practices. Participants specifically referred 
to a number of examples: the State efforts under Title III sponsorship; 
the experience of the various ERIC centers in disseminating information 
about subject areas (science, social studies); and the recent efforts 
performed by private contractors for both USOE and NIE to identify* 
validate and disseminate exemplary educational programs developed by 
local districts. 

The state -of. the >art study which would begin immediately would 
be an action study, that would only be successful if the field is directly 
involved in a corollary "political process. " The unsatisfactory record 
of such studies in helping educational practioners is a result of ignoring 
the people and political relationships which are essential to evolving 
coordinated, cooperative action based on the study itself. Therefore* 
as part of this recommendation it is suggested that NIE enter into a 
partnership with all education levels to conduct a state-of-the-art study^ 
and to develop its long-range plans. 
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Evaluation of the Impact of Increasing the Use of Promisina 
Pcacticca Information """"""^ " " 

Recommendations t 

1. The impact of disseminating promising practices informa- 
tion should be explored in order to develop criteria for 
judging the effectiveness of dissemination. Three areas 
of potential impact which need to be escplored include 

(I) awareness: (2) decisions to adopt or adapt a given 
program; and (3) relationship of the dissemination and 
information to program success at the adopting site. 

2. An in-depth case study is needed to determine if a high level 
of 'use" of promising practices information by LEA's has 
an impact (I) on actual classroom instruction* and (2) on 
student outcomes. 

Evaluation activities might seem only indirectly related to the 
problems of increasing the use of promising practices information. 
Participants, however, felt there was a critical long-range need for 
a clear specification of the outcomes of dissemination activities, and 
for an in-depth study of whether or not promising practices informa- 
tion impacted on students. 

Long-range development of a coordinated system requires an 
immediate concern about how a system can be judged to be effective. 
In addition, decision-maker? at all governmental levels who support 
dissemination will expect results from the resources and efforts put 
into Uisstrxnination. These improvements will require a clear definition 
of goals and criteria for evaluating whether goals have been achieved. 

Suggested Areas for Exploration. The areas specified in the 
recommendation resulted from extensive workshop discussions over 
the need for evaluating the effectiveness of dissemination in terms of 
what is meaningful to the consumer at the LEA level. The areas con- 
stitute those about which the participants felt most attention should be 
paid, and relationships explored in order to develop criteria for mea- 
suring the full potential of information services. 
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The creation of a greater awareness about available resources 
and inCormatiun is seen as a major, and measurable outcome of a 
dissemination system. Most LEA staff are not aware of the informa- 
tion resources and services already available to help them meet their 
needs: this lack of awareness continues to be a problem and thus of 
major concern even for a comprehensive information center serving 
an identified target audience. It was felt that efforts to increase the 
awareness of local educators about information resources would con- 
stitute a valid area for exploration and development of specific criteria. 

The actual use of information in local decision -making is the 
second area requiring exploration. Participants were particularly 
concerned that the use of promising practices information itself should 
be separated from actual adoption. The validity of rational decision 
for "non -adoption" of a program based on information from a dissemi- 
nation system is often overlooked or viewed as negative, and does not 
' ct.unt" when questions are raised concerning the "effectiveness" of a 
dissemination system. Measures for such variables as the 
adequacy of the information for decision-making process are needed. 

The third area would be an exploration of the relationship between 
dissemination processes and information content, and the success of 
program implementation. The question raised is whether a dissemina- 
tion system can or should be evaluated in relation to the effectiveness 
of program implementation. Some of the questions to be answered are 
how the quality of the information, or of information services them- 
selves, affect eventual success in implementation. 

In-Depth Case; Study of the Impact of Disseminating Promising 
Practic es Information. A basic assumption about promising practices 
is they they will make a difference for teachers, and for students, if 
they can be effectively disseminated. But how do we know? The rec- 
ommendation was discussed as possibly a regional study, in a multi- 
State area that has achieved a significant level or "threshold" of dis- 
semination activity (New England was suggested). The study would 
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attempt to determine the observable effects on students^ perhaps in 
the form of disproving the null hypothesis: that no differences occur 
as a result of this activity. The study would in effect be a test of 
whether the investment in promising practices information can be 
justified. 

The case study was seen as a significant contribution to the 
state of the art, as participants felt it should examine what compo. 
nents of dissemination produced desired outcomes. 

This recommendation might be viewed as contributing to the 
increased use of promising practices by building a more rational 
foundation for the activities of professionals in this field the 
linking agents and information specialists at all levels, and for 
program managers at State and Federal levels who must justify 
budget requests. Rather than meeting an "immediate need", the 
case study is an essential step for long-range planning. 
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ANALYSIS 



A major portion of the conference discussions involved exam, 
ining the implications of specific strategies. This section, based on 
review of the discussion tapes and recorder notes, is intended to pro- 
vide some perspective on the recommendations as initial steps in re- 
lation to the overall goal of increasing the use of promising practices 
information. 

The Nature of the Recommendations 

The recommendations carry some general Implications for the 
type of action that is needed ;these itnplications can be summarized as: 

• The need for a common knowledge base concerning loca-x 
education agency decision-making practices. 

• The need for defining roles and responsibilities In rela- 
tion to shared objectives, in order to develop mutual 
accountability* 

• The need for an open and interactive system of com- 
munication about this and other problems so that infor- 
mation about failure and success can be shared. 

• The need for long-range planning and consistent, mutu- 
ally acceptable management procedures for the existing 
"system", before a major increase in funds can be 
well- spent. 

Roles and Responsibilities 

The strongest implications in the recommendations concerns the 
roles the various governmental levels should assume in increasing 
the use of promising practices information. This subsection draws 
together the major concerns of participants regarding the roles of 
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NIE, the States, local education agencies, information centers and 
universities. The order of their discussion is for convenience, 
rather than indicating a hierarchy of importance. 

The Role of NIE. The role NIE should play was by far the 
area of greatest agreement: NIE is seen as providing the 
leadership to coordinate the efforts of all of the agencies and sys- 
tems involved with promising practices information. 

The role of NIE was described by a number of key terms: as 
a "facilitator," "mediator," "coordinator," and in "partnership" 
vith all other levels of the educational system. These terms 
help define NIE' a leadership role in the area of promising practices, 
and more broadly, in the whole area of dissemination of educational 
information. 

Those involved in this area realized they cannot "coordinate 
themselves," particularly at the State level, or among the 
diverse information centers and services. The potential for NIE 
leadership appears enormous and is enhanced because NIE is seen 
not as a program and guideline-oriented agency, but one mandated 
and free to work in partnership with all governmental and private 
levels in developing policies and implementing new approaches. 

The leadership role for NIE cuts across all of the areas related 
to the greater utilization of promising practices information. This 
broad responsibility, and the interdependence of different functions 
such as dissemination, or identification and selection, implies that 
NIE should not concentrate all of its resources on one functional 
activity. 

The essence of this leadership role is to facilitate the at:ceptance 
of responsibilities and the commitment of resources by other agencies, 
at other levels. Perhaps part of the rationale for the conference not 
recommending any major new Federal funding for this area stems 
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from their concern that State depiirtmeits of education, national 
and regional information services ;?nd centers should assume respon- 
sibilities in this area, responsibility which total Federal funding 
might reduce. 

The Role of the States . Instead of envisioning a national* level 
system in collecting and disseminating promising practices informa- 
tion, the conference viewed the collection and dissemination of prom- 
ising practices information as a function involving State education 
agencies very directly. There can be no single model for all States, 
and therefore, no specific prescriptions as to what the State agencies 
"should do" but the States are seen as the pivotal agency. There was 
strong consensus among LEA 's, information centers, and national 
educational program specialists, that all SEA»s could take on a 
stronger coordinating role to increase the use of promising prac- 
tices information. 

Most of the recommendations would strengthen the SEA 's role 
and responsibilities, and facilitate a positive role for them in infor- 
mation collection and dissemination. The SEA's are envisioned 
working as partners with NIE to establish consistent selection pro- 
cesses and criteria, and to develop and implement a common format 
for promising practices information. The need for quality control 
could thus be best met by State- level action. 

The general responsibility of SEA's to take on a coordinating 
role in this area reflects the changing functions of the SEA's. Rep- 
resentatives at the conference, from all levels, saw the SEA as 
moving toward developing the capabilities to assist local school 
districts in the overall management of education. This change from 
a traditional, largely regulatory role toward an interactive, service- 
oriented role includes dissemination of information as one specific 
component, but linked into a comprehensive set of services. 
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The Role of the LEA. Local education agencies have a twofold 
responsibility in increasing the iK^e of promising practices information. 
As participants in the planning process the input of LEA representatives 
is critical to understanding user needs and developing specific steps to 
implement recommendations. As consumers, the implications for 
increasing use will require improvement in local capabiliHes to utilize 
promising practices information. 

A diversity of LEA's must be represented within the kind of inte- 
grated, rnwlti-level planning exemplified by the conference. Their 
concerns and requirements need to be heard directly by decision- 
makers at other levels and made part of an integrated plan. They 
should not be asked to serve together as a separate advisory body. 

The major implication for all local education agencies as infor- 
mation consumers is their need to assume a greater responsibility in 
the initial process of identifying goals and assessing needs for infor- 
mation. The lack of on-going needs assessment was identified as one 
of the greatest constraints on the eventual utilization of information. 
An additional responsibility implied by the recommendation for a 
common format would be to increase the LEA's capability as the initial 
producer of information. To meet this requirement, however, it is 
clear there must be additional resources, incentives and training for 
local staff. 

A ftnal and most crucial responsibility is to establish the stan- 
dards for accountability for other agencies and institutions that provide 
LEA'S with information services and technical assistance. As LEA's 
begin to develop strong planning /management systems and become 
accountable to their own parent or community advisory committees, 
the LEA is in a position to develop criteria for evaluating services 
provided by State and Federal agencies. The need for accountability 
between levels became very evident during the conference, as LEA's 
began identifying what they required. It should be emphasized that the 
standards LEA's use to specify information needed from other levels 
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(in order to meet the objectives they have set for themselves) are 
stated in terms of the effective delivery of resources and services, 
not "Why isn't there more money available ?" 

The Information Centers. Two basic types of information centers 
were represented at the conference and were seen as having different 
responsibilities in increasing the use of promising practices information. 

An information center at a national level would appear to improve 
the quality of information about a subject or content area, serve as a 
central resource for not only State and sub-State information services 
in the area, but also serve LEA's interested and motivated to contact 
them. Some ERIC Clearinghouses have developed strong information 
resource centers that collect, disseminate locally- developed educa- 
tional practices along with other information, and provide some direct 
technical assistance. 

The information centers operating at a State or sub-State level 
were seen as providing LEA's with a comprehensive range of infor- 
mation services. In implementing the recommendations to increase 
the use of promising practices information, these informaHon centers 
could take on the responsibility of testing out new formats, and deter- 
mining user-oriented criteria for selecting different types of promising 
practices for different uses. Their direct contact with a population of 
LEA'S could be used to provide direct feedback to the national level on 
suggested improvements. 

Within an improved and coordinated system, the role of regional 
or local information centers would include more involvement with 
LEA's in the identification and development of promising practices 
information for selection into various collections. Where such cen- 
ters already exist, or may be initiated, they are the critical medi- 
ators linking the user of information to more remote resources. The 
information center that can work directly and continuously with LEA 
staff has a unique and powerful role to play in facilitating systematic 
changes and increased competence in problem-solving among local 
education agencies. 
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The University. University Schools of Education can have a 
much greater role to play in facilitating the use of educational infor- 
mation, primarily because of the new responsibilities LEA's must 
assume in utilizing outside knowledge. Within the context of a coordi- 
nated system, the potential responsibilities for the university include 
technical assistance to school systems, training of educators as infor- 
mation users, as well as becoming the site of an active information 
serWce for surrounding LEA's. 

Universities serve as traditional sources of information for 
educators, and many schools of education are now repositories of 
ERIC microfiche collections. The need for more direct information 
services niight be met in many areas by the development of a university- 
based, user- responsive information service for local schools. Such 
a center could become part of student training experience, and then 
serve as a known resource to draw upon once in the field. 

Additional Implications for Implementation 

In summary, the recommendations can be examined in terms of 
financial requirements, and for their sequence in time. 

The effect of the workshop process, and of the diverse and exper- 
enced group of participants, was to focus discussions on identifying 
strategies having greatest possibility of realistic implementation within 
known constraints, rather than on more idealistic possibilities. The 
conference was particularly sensitive to the realities of NIE's Umited 
financial resources, and therefore, specific recommendations tend to 
be strategies that could be initiated with limited funding. 

The apparent feasibility of the recommendations in terms of 
financial costs is balanced by an increased need for cooperative action 
and coordination of resources from other agencies and groups at all 
levels. The implications for NIE's planning process appears to be that 
its available funds should be directed toward facilitating the coopera- 
tive'processes essential to implementation. 
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The recommendations developed have been presented as separate 
strategies in response to priority problems. However, the degree of 
success of implementing any given recommendation would appear to 
be highly dependent on coordination with strategies to resolve other 
problems. In effect, the interdependence of the specific problems 
in this area impUes that even minimal attention across all problems in 
the immediate future would ensure more overall impact, rather than 
focusing on only one identified problem, such as the need for a com- 
mon format, outside the context of a plan of action. 

This interdependence suggests that implementation of the recom- 
mendations would have a maximum impact if it could occur in the fol- 
lowing sequence: 

U Development and sharing of an initial plan of action; 

2. Organization of a task force for planning a cooperative 
network; 

3. Organization of represenUtive task forces for developing 
user -specific categories, formats, and criteria and pro- 
cesses for promising practices information; 

4. Outlining the scope of a state-of-the-art study and develop- 
ing support for its results; 

5. Initiation of the st&te-of-the-art study and case study to 
analyze impact of increased use; 

6. Incorporation of initial products of items 3, 4, and 5 into 
the workshops for developing state networks; 

7. Revision of plan of action based on a state-of-the-art study. 
This organizational sequence envisions the initiation of planning 

processes that would focus on each given issue or problem identified 
by this conference after a general framework had been established. 
All these initial efforts would need to feed back into an on-going 
planning process for the developing state-of-the-art study. 
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III. CRI OBSERVATIONS 



The conference proved rich in both the quality and quantity of 
discussions, and generated more information related to new insights 
and conclusions than could be incorporated into specific recommenda- 
tions. From these discussions CRI has formulated additional obser- 
vations, and suggestions which are offered here for consideration. 

The first part of this section presents suggestions based on our 
analysis of die conference data and additional information provided 
directly by participants. The suggestions are offered because we 
believe part of our responsibility as a third party resource is to 
learn as much as we can, and to document and share with decision- 
makers in NIE and elsewhere the results of this eicperience. The 
CRI recommendations are in no way "alternatives" to the major 
conference recommendations; we hope they will be helpful in under- 
standing how particular recommendations might be implemented, 
and what additional efforts might be considered* 

The section concludes with observations on the success of the 
conference in meeting its objectives, and the potential value for 
improving education that CRI sees resulting from the efforts to 
increase the use of promising practices information. 

SU66E$TI0NS 

The following section presents CRI*s suggestions drawn from 
the conference experience. We realize that some of what is stated 
here may have already been explored or suggested, but because of 
the diverse audience that this report will reach, we feel it is useful 
to present and re-err^hasize these points. 
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Task Force 



NiE should consider development of an on-going Task Force of 
people similar to those invited to this initial conference, to work as a 
joint planning body across all problem areas related to protxUsing prac- 
tices information. This might include those already identified in the 
recommendation for developing a cooperative network and include a 
significant number of representatives from LEA's as well as repre- 
sentatives from all agencies and government levels. 

Workshops on LEA Use 

NIE might consider holding additional exploratory workshops 
focused on the use of promising practices information by local educa* 
tion agencies. Workshops could be held rather easily and quickly by 
re -involving some of the original conference participants and drawing 
in a new, broader range of local educators. The workshops should in- 
volve LEA representatives who are less eacperienced in their orientation 
toward information resources and their use in program planning, and 
who can thus help pinpoint more barriers to increased use. This would 
be helpful in focusing the initial planning and raising more basic ques- 
tions that need to be answered. 

Information Systems Education 

NIE should begin to develop long-range plans for educating local 
school staff in the use of new information systems --in terms of the 
concepts implicit in whatever formats are used, for identification and 
selection of promising practices information. 

Handbook on ERIC Use 

NIE may wish to consider developing a handbook or user's guide 
that illustrates how promising practices information can be accessed 
from the existing information system. This might facilitate increased 
use of the existing ERIC system. Most local educators may not have 
direct access to ERIC files; however, developing and testing such a 
handbook would provide an indication of whether direct access is a 
feasible option. 
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Federal Funds for State Use 

NIE should explore the possibilities of setting aside Federal funds 
for State-level efforts to identify, select and disseminate promising 
practices information, as it may not be possible to resolve at the Federal 
level current conflicts over the effect of Federal priorities and the appli- 
cation of regorous standards. 

Case Study on Problem -Solvin|^ 

NIE should consider supporting a study on the impact of providing 
comprehensive information services on local school processes for pro- 
blem-solving and decisions to improve educational programs. Informa- 
tion center staffs indicate the dynamic changes occur in the nature of 
the requests from superintendents, principals, and teachers as they 
begin experiencing. the usefulness of information provided in response 
to initial requests. 

The case study could provide documentation of how change occurs 
in actual settings, as well as the relative degree of change, achieved 
through contact with an information center. This study would explore 
linkage to an information center as an alternative to other strategies 
for improving local school management of the educational process. 
Additional Information Centers 

NIE should explore alternatives for developing new information 
centers without initial high level Federal Funding. The development 
of additional information centers responsive to local education agency 
needs appears to be an essential step in building an effective system 
for the dissemination and utilization of all educational knowledge. 
Centers that depend on local rather than Federal support would ensure 
that local needs are being met. 

Several possible ''models*' already exist, and would appear to be 
equally viable. One is the cooperative center, supported and governed 
by neighboring school districts. It provides a comprehensive range of 
services in program planning, staff training and information resources 
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to member districts. A second model is a more independent information 
center, partially attached to a local or intermediate education unit, and 
providing a variety o£ information services to any education agencies 
that wish to purchase them. A third model would appear to include re- 
gional service centers supported by State funds, providing services to 
all local education agencies in their area. 

Technical Assistance 

A critical problem LEA's continue to confront is the lack of tech- 
nical assistance. Actual use of promising practices information is 
critically dependent on technical assistance --in other words, people 
to provide for needs assessment, help in adapting specific approaches 
and in evaluation. NEE should consider instituting a review of policies 
at Federal and State levels to ensure that resources are not eacpended 
in the development and dissennination of promising practices information, 
without providing for specific technical assistance to local schools in 
using such information. 

Training 

In order to support the recommendation on training, NIE should 
explore the current education of teachers in pre-service and in-service 
and of educational administrators, to determine their current levels of 
awareness regarding the utilization of information in solving educational 
problems. The development of coordinated dissemination /diffusion sys- 
tems to meet LEA needs will require a simultaneous effort to reach and 
educate local educators in the existence, purpose, and use of such systems. 

CONCLUSION 

In concluding this report, CRI would like to offer some observations 
on the success of the conference, and on the value of increasing the use of 
promising practices information. 

The objectives NIE established for this conference were that it identify 
those factors that currently prevent increased use of promising practices 
information, and recommend strategies for increasing such use. 
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The conference recommendafcions, and the insights into the nature 
of the problem which it has provided wcxild seem to have met these ob- 
jectives with a reasonable degree of success. 

As would be anticipated from a group of professionals who are 
confronted with the daily pressures of meeting the demands of col- 
leagues in the field, there appeared to be a great pressure initially to 
define needs in terms of what he (or she) needed to help perform on- 
the-job tomorrow, 

. The fact that the participants proceeded in this fashion suggests 
that any analysis of needs in the future probably should be divided into: 
I). immediate needs of those who have responsibilities in this area, and 
Z) long-range needs of the field of education with regard to the develop- 
ment and diffusion of "promising practices.'* Needs in both these areas 
should be clarified recognising that some needs in each area may be 
mutually exclusive and that where the same need exists in connection 
with both immediate and long-range plaxming, the priority of importance 
with regard to meeting the need may differ. For example, the need for 
standardizing format may be a high priority item from the perspective 
of immediate needs, but may be a much lower priority item with reference 
to long-range planning. 

The support by participants for a major state-of-the-art study re- 
flects their recognition that the discussions could only scratch the surface 
of some problems, and that many basic issues would not be addressed. 

The conference facilitated additional outcomes which are more 
difficult to document, but which may be of equal or greater value tiian 
the immediate recording of its stated products in this report. The work- 
shop process resulted in a personal involvement and commitment by par- 
ticipants as a consequence of their efforts. Thus, a concern developed 
^nd was expressed at the last session over whether there would be an 
.opportunity for participants to remain involved with NIE in planning and 
decision-making. 
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A positive outcome of this was that participants who had ideatitied 
resources from other levels or agencies held their own group strategy 
sessions before leaving the conference. One of these has already re- 
sulted in a pilot efi'>rt to coordinate information resources among several 
States and information centers, A longer conference would have allowoU 
such multi-level planning to have been incorporated s^mA documented* 

From CRI's perspective as a third-party resource, the conference 
demonstrated convincingly that joint planning across governmental levels 
can be a viable and effective process. H demonstrated the tidcessity for 
all levels to be directly involved and interacting with each other rather 
than always remaining in role groups. And it demoivstrated the potential 
for NIE to contifiue this effort in educational leadership, working co- 
operatively with its constituency. 

The Value of Increasing the Use of Promising Practices Information. 
Educational policy -makers at any level need to Justify resources for in- 
creasing the use of promising practices information by showing how it 
will lead to improvement in the practice of education itself. 

The usual assumption has been that promising practices represent 
successful field-tested approaches which will improve edutiation for 
children when disseminated and adopted by other schools. The tentative 
conclusion CRI has drawn as to the value of promising practices informa- 
tion challenges this basic assumption and the processes created by the 
use of this information that will make the greatest impact in educational 
]^ractice. 

NI£ faces the challenge of assisting 18.000 local school districts, 
traditionally autonomous, to improve their educational programs. A 
coordinated information system for sharing information about success and 
failure of local educational efforts can provide local educators the kind 
of continued learning process they need. The specific bits of information 
in the system -- the individual strategies or practices — become less 
important than the cognitive framework they provide as a whole. Such a 
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learning system can only- come about if local educators are involved as 
producers as well as consumers of information, if the local school 
comes to see itself as a valuable resource for the information it pos- 
sesses about educational practice. 
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Summary of Conference Working Paper 



As a preparatton for the conference, CRI asked participants to 
provide information on the current problems they experience, and 
practices or other activities related to the LEA use of promising 
practices information. Parttcipants were asked to identify specific 
problems which they felt hindered the use of promising practices 
information, in order to determine any pre-existing consensus or 
obvious biasing towards any one aspect of ^e problem (Eachibit A). 
Quick analysis revealed that critical problems were perceived in ' 
every area, A slight niajority indicated that the utilization /adoption 
aspect was the greatest problem area, rather than information dev- 
elopment or dissemination a fact %vhich proved to be true at the 
conference. 

The information was particularly helpful in two ways: 1) it pro- 
vided the understanding of the participants^ concerns and diversity of 
experience to structure the agenda and discussion groups; 2) problems 
and concerns, as well as the experiences, could be shared among the 
participants prior to the conference by means of a working paper pre- 
pared by CRI. This gave participants a frame of reference and a point 
to move from the start of the conference. 
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Problems Hindering the Use of Promising Practices Information 
Problems In Information Development 



Descriptions/Formats 
Personal time 
Priority- 
Use of media 
Program interference 
Packaging 
Fvtnds 

Needs a.ssessment 
Validation instnunent 
Quality - program/products 
Selection/Criteria/Evalxiation data 



Production facilities 

Systematization 

AV production/Formatting 

National coordination 

Staff 

Incentives 
Know-how 

Technical assistance 
Provincialism 
Identification procedures 
Duplication 



Problems With Dissemination/ Awareness 



Project capability 

Dissemination /Awareness 
Time 

Knowledge of resources 
Quality of descriptions 
New money 

Present means too expensive 
External validity 
^Criteria for reporting 
Technical personnel for promotion 
Trained field/linking agents 

Federal/State /District commitment 

Media 

Identifying local district gatekeepers 



Coverage to teachers 

Descriptions/Format 

Interest/Motivation/Incentives 
Central source 

Funding or creating channels 
Timeliness 

Concern about needs of other LCA's 
In-service training 
Communications network 
Planning/Assessment 
Assessment of critical inforznation 
needs 

Interaction between developer/ 
disseminator 



Problems with Utili 

Technical assistance 

Product form {inflexible, ambiguous) 

Money 

Inertia 

Sense of ownership 
Preparation of materials 
Chiin^e agent 
Credibility 

Implementation assistance 
Generaliaability 
Teacher tilne 

State/District commitment 
Incentive/Motivation 



ion /Adaption 

Target audience 
Alternatives 

Matching new practices to 

existing needs 
Knowledge/ Comprehension/ 

Utilization of services 
Needs assessment 
New approaches 
New ways to make decisions 
Leadership 
Demonstration sites 
Distance between usjer and developer 
Interaction between user and develope 



